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<£ ' Abstract 

w , This paper studies the moment boundedness of solutions of linear stochastic 

J3 delay differential equations with distributed delay. For a linear stochastic de- 

lay differential equation, the first moment stability is known to be identical 
to that of the corresponding deterministic delay differential equation. How- 
ever, boundedness of the second moment is complicated and depends on the 
stochastic terms. In this paper, the characteristic function of the equation 
is obtained through techniques of Laplace transform. From the characteris- 



tic equation, sufficient conditions for the second moment to be bounded or 
unbounded are proposed. 
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1. Introduction 

Time delays are known to be involved in many processes in biology, chem- 
istry, physics, engineering, etc., and delay differential equations are widely 
used in describing these processes. Delay differential equations have been ex- 
tensively developed in the past several decades (see [l|, y, |3|). Furthermore, 
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stochastic perturbations are often introduced into these deterministic sys- 
tems in order to describe the effects of fluctuations in real environment, and 
thus yield stochastic delay differential equations. Mathematically, stochastic 
delay differential equations were first introduced by Ito and Nisio in the 1 960s 
[8] in which the existence and uniqueness of the solutions have been inves- 
tigated. In the last several decades, numerous studies have been developed 
toward the study of stochastic delay differential equations, such as stochastic 
stability, Lyapunov functional method, Lyapunov exponent, stochastic flow, 
invariant measure, invariant manifold, numerical approximation and attrac- 
tion etc. (see plM l9Ml2l. ll4H171. Il9l-l22| and the references therein) . However, 



many basic issues remain unsolved even for a simple linear equation with 
constant coefficients. 

In this paper, we study the following linear stochastic differential equation 
with distributed delay 



-+oo 

dx(t) = ( ax(t) + b I K(s)x(t — s)ds ) dt 



+ ( ctq + 0\x(t) + a 2 K(s)x{t - s)ds J dW t . 



;i-i) 



Here a,b and Oi{i = 0, 1,2) are constants, Wt is a one dimensional Wiener 
process, and K(s) represents the density function of the delay s. In this 
study, we always assume Ito interpretation for the stochastic integral. This 
paper studies the moment boundedness of the solutions of (11.11) . Particularly, 
this paper gives the characteristic function of the equation, through which 
sufficient conditions for the second moment to be bounded or unbounded are 
obtained. 

Despite the simplicity of (jl.ip . which is a linear equation with constant 
coefficients, current understanding for how the stability and moment bound- 
edness depend on the equation coefficients is still incomplete. Most of known 
results are obtained through the method of Lyapunov functional. The Lya- 
punov functional method is useful for investigating the stability of differential 
equations, and has been well developed for delay differential equations [7J, 



stochastic differential equations [15j, and stochastic delay differential equa- 
tions lGj, llll, uA, ll5||- The Lyapunov functional method can usually give 
sufficient conditions for the stability of stochastic delay differential equa- 
tions. For general results one can refer to the Razumikhin-type theorems 
on the exponential stability for the stochastic functional differential equation 



la . Chapter 5]. However, these results often depend on the method of how 



the Lyapunov functional is constructed and are incomplete, not always ap- 
plicable for all parameter regions. For example, sufficient conditions for the 
pth mom ent stability of following stochastic differential delay equation 

dx{t) = (ax(t) + bx(t - r)) dt + {ar x x{t) + cr 2 x(t - r)) dW t , (1.2) 



can be obtained when a < 0, but not for a > [151 . Example 6.9 in Chapter 
5]. 



In 2007, Lei and Mackey [13j introduced the method of Laplace transform 
to study the stability and moment boundedness of the equation (11.11) with 
discrete delay (K(s) = S(s — 1)). In this particular case, the characteristic 
equation was proposed, which yields a sufficient (and is also necessary if not 
of the critical situation) condition for the boundedness of the second moment 
(see Theorem 3.6 in 13j). This result gives a complete description for the 
second moment stability of the equation (II. 2p (the delay can be rescaled to 
r=l). Nevertheless, there is a disadvantage in the characteristic equation 
proposed in [13J in that the characteristic function is not explicitly given by 
the equation coefficients. Therefore, it is not convenient in applications. 

The purposes of this paper are to study the stochastic delay differential 
equation (ll.ip and to obtain a characteristic function that is given explicitly 
through the equation coefficients. 

Rest of this paper is organized as follows. In Section 2 we briefly intro- 
duce basic results for the fundamental solutions of linear delay differential 
equations with distributed delay. Main results and proofs of this paper are 
given in Section 3. In Section 3.1 we discuss the first moment stability and 
show that it is identical to that of the unperturbed delay differential equa- 
tion (12. ip (Theorem 13. 3p . Section 3.2 focuses on the second moment. When 
the stochastic perturbation is an additive noise, the result is simple and the 
bounded condition for the second moment is the same as the stability condi- 
tion for the unperturbed delay differential equation (Theorem 13 .41) . However, 
in the presence of multiplicative white noises, boundedness for the second mo- 
ment depends on the perturbation terms. We prove that the second moment 
is unbounded provided that the trivial solution of the unperturbed equation 
is unstable (Theorem I3.6J) . When the trivial solution of the unperturbed 
equation is stable, we obtain a characteristic equation, and the boundedness 
of the second moments depends on the maximum real parts of all roots of the 
characteristic equation (Theorem 13. 8p . The characteristic function is given 
explicitly through the equation parameters. In Section 4, as applications, we 



obtain some useful conditions for the boundedness of the second moment in 
some special situations (Theorem 14. ip . and also sufficient conditions for the 
second moment to be unbounded (Theorem 14.21) . An example is studied in 
Section 5. 

2. Preliminaries 

In this section, we first give some basic results for the fundamental solu- 
tion of a linear differential equation with distributed delay 

^l = ax{t)+b [ X K{s)x{t-s)ds. (2.1) 

at J 

We also give sufficient and necessary conditions for the stability of the trivial 
solution of equation (12. ip . which are useful for the rest of this paper. The lin- 
ear delay differential equation has been studied extensively and the existence 
and uniqueness of the solution can be referred to |l|, |2J, |7|. 

First, we give some basic assumptions through out this paper. We al- 
ways assume that the initial functions of ( 11. ip and ( 12. ip are x = <fi G 
BC ((— oo, 0], M). Here BC ((— oo, 0], M) means the space of all bounded and 
continuous functions <fi : (— oo, 0] — > R endowed with the norm 

11011= sup imi 

0e(-oo,o] 

The delay kernel K is a nonnegative piecewise continuous function defined 
on [0,+oo), satisfying 

K(s)ds = 1 (2.2) 

'o 

and there is a positive constant /x such that 



We denote 



e fls K(s)ds < +oo. (2.3) 

o 



p= / e fls K(s)ds (2.4) 

'o 



for convenience. For example, if we have gamma distribution delays: 



r j s j-l e -rs 



K(s)= , s>0, r>0, j = l,2,3,--- (2.5) 



then (12. 2 p holds and ( 12. 3 p is satisfied for any ji G (0,r). 

For general linear functional differential equations, Lemmas 12.11 and 12.21 
below are known results (see Chapter 3 in [1]). However, for convenience and 
to emphasize the dependence on the delay kernel K, we present Lemmas 12.11 
and 12.21 here and the proofs are given in Appendix A. 

Lemma 2.1. Let x^t) to be the solution of (12. ip with initial function <fi G 
BC{{— co, 0], R). Then there exist positive constants A = A{b, 0, K) and 7 = 
7(0, b) such that 

M£)|<Ae 7t , £>0. (2.6) 

The fundamental solution of the delay differential equation (12. ip . denoted 
by X(t), is defined as the solution of (12. ip with initial condition 

Any solutions of (12.11) with initial function G BC((— 00, 0],R) can be rep- 
resented through the fundamental solution X(t) as follows. 

Lemma 2.2. Let x^{t) to be the solution of (12.11) with initial function <fi G 
£C((-oo,0],R). Then 

x 4 ,{t) = x(t)<p(o) + b / x(t-s) / K{e) ( j){s-e)deds ) t>o. (2.7) 

^0 J s 

Properties of the fundamental solution X(t) are closely related to the 
characteristic function of (12. ip defined below. For any function f(t) : [0, +00) — y 
R which is measurable and satisfies 

|/(t)|<aie a2< , £G[0,+oo), 

for some constants 0*1,0,2, the Laplace transform 



>C(/)(A) 



r+00 

/ e- xt f(t)dt, AG 
Jo 



exists and is an analytic function of A for Re(A) > 02- Through the Laplace 
transform C(K) of the delay kernel K, the characteristic function of (12.11) is 
given by 

h(X) = X-a-bC(K)(X). (2.8) 



It is easy to see that h(X) is well defined and analytic when Re(A) > — /x, and 

C(X)(\) = l/h{\). (2.9) 

Now, we can obtain the precise exponential bound of the fundamental 
solution X(t) in terms of the supremum of the real parts of all roots of the 
characteristic function h(X). 

First, we note that h(X) is analytic when Re(A) > — /i, and therefore 
all zeros of h(X) are isolated. Following the discussion in [3, Lemma 4.1 
in Chapter 1] and f 12 . 3 j) . there is a real number a® such that all roots of 
h(X) = satisfy Re(A) < «o- Thus, «o = sup{Re(A) : h(X) = 0} is well 
defined. Furthermore, there are only a finite number of roots in any close 
subset in the complex plane. 

Theorem 2.3. Let a = sup{Re(A) : h(X) = 0, A G C}. Then 

1. for any a > ao, there exists a positive constant C\ = Ci(a) such that 
the fundamental solution X(t) satisfies 

\X(t)\ <C x e a \ t>0; (2.10) 

2. for any cti < a , there exist a e (ai,a ) and a subset U C M + with 
measure m(U) = +oo such that the fundamental solution X(t) satisfies 

\X(t)\>e"\ VteU. (2.11) 

Proof. 1. The proof of (I2.10p is the same as that of [3, Theorem 5.2 in 
Chapter 1] and is omitted here. 

2. Let «i < «o- Since all zeros of h(X) are isolated, we can take a G 
(ai,ao) such that the line Re(A) = a contains no root of the characteristic 
equation h(X) = 0. Next, choose c > cto, then 

1 rc+iT e \t 



X(t) = lim / tttt^A. (2.12) 

v ; 2ni t^+oo J c _ iT h{X) V ; 

To calculate the integral in f 1 2 . X 2 [) . we consider the integration of the 
function e xt /h(X) around the bounder of the box in the complex plane with 
boundary T = LiMiL 2 M 2 in the anticlockwise direction, where the segment 
Li is the set {c + ir : — T < r < T}, the segment L 2 is the set {a + ir : — T < 
T <■ T}, the segment Mi is the set {u + %T : a < u < c} and the segment M 2 



is the set {u — iT : a < u < c}. From the Cauchy theorem of residues, we 
obtain 






,Xt 



h(\y 



(2.13) 



where Ax,A 2 , ••• , A m are all roots of h(X) = inside V (m > 1 from the 
definition of ao, and m < +oo since h(X) is an analytic function). Here we 
assume further 



a < Re(Ai) < Re(A 2 ) < ■ ■ ■ < Re(A m ) < a . 



We note that 



.,xt 



Res 



X=Xi 



h(X) 



P 3 {t)e> 



where Pj{t) is a nonzero polynomial of t with degree given by the multiplicity 
of Xj — 1. Thus, 



l^=^twv 



(2.14) 



There exists a positive constant T such that for T > T and u > —fi, 



\h(u + iT)\ Vu 2 + T 2 -\a\-\b\p 1 
T ~ f ~ 2' 



Therefore, when T is large enough 



Mi 



h(X) 



dX 



c+iT e \t 



< 



c 



it HX) 



dX 



'id 



a Vu 2 + T 2 -\a\-\b\p 



-du 



< -e ct (c-a) ^0 (asT^+oo). 



Similarly, we have 



,xt 



<M 2 MA) 
Therefore from (12. 14ft we get 



dX 



->■ (as T ^ +oo). 



1 f c+iT e xt 
lim / — — 

2ni t^+og J c _ iT h(X) 



dX H lim 

2ni t-^+oo 



a-iT e Xt 



a+iT 



h(X) 



dx=j2my 



i=i 



which implies 



where 



X(t)=X a (t) + ^P J (t)e 



\,i 



Xa{t) = ^- lim f 

2m t^+oo J- 



a+iT e \t 



d\. 



la-iT Htf 

Similar to the proof of (I2.10p . there exists a positive constant C\ = C\{a) 
such that X & (t) satisfies 



\Xa(t)\ <C ie at (t>0). 



(2.15) 



Thus 



\X(t)\ > 



E p ^> 

3=1 



,\it 



-\Mt)\ > 



3 = 1 



-de 



at 



e si (e (Re(Al) - a)t /(t) - C x ), 



where /(*) = | ^P,-(t)e 



(Aj-ReCAi))*! 



J=l 



Let Aj = (5j + iWj, and assume k such that /3j < (3 m when 1 < j < k, and 



/3j = m when fe + 1 < j < m, then 



/(*) 



(p m -Pi)t 






-{p m -pj)t 



P j {t)e i ^ t + J2 Pj(t)e iuJjt 



j=k+i 



> 



E R*(^-(*)e 



iuijt*' 



3=1 



Since -Pj(t) are nonzero polynomials, there are a positive constant e > and 
a subset C/ C M + with measure m(U) = +oo such that for any t <E £/p 



3 It is easy to see that Y^jLk+i R-e(Pj(i)e JWjt ) = ^ n ETlfc+i( a j cos(wji) + 6j sin(cjj£)) + 
0(t~ 1 )] (t — > +oo) where aj,bj are constants, and n is the highest degree of the polynomials 
Pj(t)(j = fc + 1, • • • , rn). Thus, we can always find a subset Uq with measure m(Uo) = +oo 
so that all functions a,j cos(ojjt) + bj sm(u> jt) > e (k + 1 < j < m, Vi 6 Uq) for some small 
positive constant e (detail proof is omitted here), and therefore the subset U is always 
possible by taking U = Uq fl (to, +oo) with £q large enough. 



8 



E MPj(t)e 



iuiit\ 



>2e. 



j=k+i 



Moreover, since ^ e (A ™ ^l-fjWI -^ as t -)• +00 and Re(Ai) - a > 0, 
we can further take U such that 

e&*( Xl) - s)t f{t) - & > 1, Wet/ 



and hence ( 12. lip is concluded. □ 

From Lemma 12.21 and Theorem 12.31 asymptotical behaviors of solutions 
x^it) of equation (12. ip are determined by a . 



Theorem 2.4. Let «o be defined as in Theorem \2.3l Then for any a > 
max{ao, — /x} there exists a positive constant K\ = Ki(a, /i) such that 



Mt)\ <Kj 



-at 



t > 0, 



(2.16) 



where ji is defined as in (12. 3ft . Therefore the trivial solution of (12.11) is locally 
asymptotically stable if and only if a < 0. 



Proof. For any initial function cf) G BC((— 00, 0],' 



K(9)(j)(s 



< e 

< 

< /' 



-/is 



z^K[Q) 



d6 



,-flS 



+00 



e fi6 K{e)de 



-f/,8 



Thus from (J2.7P and Theorem 12.31 for any a > «o 







/"* 






M*)l 


< 


TO)IM + / \X(t-s)\ 
Jo 


/ #W(* - 


-6)dB 




< 


Ci||(/.||e at H-C' 1 f e^-^pUWe-^ds 
Jo 






= 


dW^e^ + C lP \\<f)\\e at / e^ a+ ^ s ds 

1 C\ 






< 


o u 

P~M< _l_ p"* 






\Oi + /i 






= 


V |a + /i|y 




Thus, (j2.16|) 


is concluded with 







ds 



K x (a,n) =d 1 + 



2p 



|a + /i| 



(2.17) 

The Theorem is proved. □ 

For a general distribution density functions K, it is not straightforward to 
obtain sufficient and necessary conditions for «o < 0. A sufficient condition 
is given below. 

Theorem 2.5. If (a, b) 6 S := S x \J S 2 , where 

Si = {(a,b) eM 2 : a <0,a <b < -a}, 

p+oo 

S 2 = {(a, b) E M 2 : -( / tK(i)dty l < b < a < 0}, 

Jo 

then cto < 0. 

Proof. Let A = a + i/3 (/3 > 0) be a solution of h(X) = 0. Separating the 
real and the imaginary parts, we have 



p+oo 

a-a-b e- at K(t) cos(f3t)dt = 0, 

, Jo 

p+oo 

P + b e~ at K(t) sm(pt)dt = 0. 

Jo 



(2.18) 



10 



If a > and (a, b) G Si, then when < b < —a 



a-a-b I e~ at K(t) cos(/3t)dt > a + b-b K{i)dt 

Jo Jo 

= a + b — b = a > 0, 

and when a < b < 

a - a - b / e~ at K(t) cos((3t)dt > a - a - \b\ K(t)dt 

Jo Jo 

= a- (a+ |6|) > a > 0. 

Hence, for (a, 6) G Si, all roots of h(X) = must have negative real parts, 
i.e., a < 0. 

If a > and (a, 5) G S 2 , then for /3 > we obtain 







/■+oo /"+oo 

+ 6 / e~ at K(t) sm([3t)dt > (3 + b K(t)(3tdt 

Jo Jo 

= /3 (l + b J tK{t)dt\ >0, 

which implies that the second equation of ( 12.18P is not satisfied. Hence «o < 
when (a, b) G S 2 . □ 

Now we give some properties of the fundamental solution X(t) which are 
useful for our estimation of the second moment in the next section. 

Obviously, both X 2 {t) and X s (t)Xi(t) have Laplace transforms (here 
X s (t) = X(t — s)). When a < 0, the explicit expression of the Laplace 
transform C(X 2 ) is obtained below. 

Since C(X) = l/h(X) and a < 0, we have 



X(t) = — / rr^du. (2.19) 

Therefore, we obtain 

/*oo -1 poo 1 /*oo 

-du. (2.20) 



27r < /_ 00 h(ioj)h(\ — iuj) 
11 



Let 



g(X,s,l) 



£(X S X,)(A) 



(2.21) 



The function g(X, s, I) is crucial for the characteristic function of ( ll.ip . Simi- 
lar to the above argument, we obtain an explicit expression of g(X, s, I) given 
in Lemma |21 



Lemma 2.6. Let g(X,s,l) defined as in (j2.2ip . then 

-du 



g(X,s,l) 



+00 — As iuj(s— I) 



h(iu)h(X — iu) 



+00 



s > I > 0, 



h(iu)h(X — iu 



+00 — XI iu(l— s) 



-du 



(2.22) 



h(iu)h(X — iu 



+00 



h(iu)h(X — iu 



-du 



-du 



< s < I. 



Proof. From (j2.19p . we have 



C{X S X{) 



e~ xt X(t - s)X(t - l)dt 



-xt 



2n 



00 iuj(t—l) 



h(iu] 



-duX{t - s)dt 



1 r°° p~ i^ p~ (^~ *w)s /"+oo 



2^ 



1 

2¥ 



h(iu) 



-(*-*»)(*-') X(t - s)dtdu 



h(iu)h(X — iu 



-du (s > I > 0) 



/■oo „— \l iu)(l— s) 

I / e e 



da; (0 < s < /). 



^./.^(iwMA-iu;) 
Thus (I2T22J) is followed from f l2T20|) . (T2T2TJ) and fl2T23|) . 



(2.23) 



D 



12 



From f )2.22p . we have 



-OO —IU)S 

-dui 



9(\s,°) = ^ W^-V . (2.24) 

-duj 



, h{iu)h{\ — iu 

The following Lemma gives an important estimation of g(A, s, Z), with the 
proof given in Appendix B. 

Lemma 2.7. Let g(X, s, 1) defined as in (j2.2ip . T/ien w/ien Re(A) > max{2ao, a, a+ 
ao, —fJ>}, for any e > 0, i/iere exzsfo a constant T = T Q (e) independent to s 
and I such that for |A| > T , 

I e !_/ +f3 T . (0<»<Q. 
Moreover, for Re(A) > max{2ao, a,a + cto, — fi}, 

lim \g(\,s,l)\ = 0. (2.26) 

|A|^+oo 

3. Moment boundedness of the equation with noise perturbation 

Now we consider the equation (jl.ip . i.e., o~j (i = 0, 1, 2) are not all zeros. 
In this section, two main results are obtained: Theorem 13.31 for the sufficient 
condition of the exponential stability of the first moment, and Theorem 13.81 
for the characteristic equation that implies the boundedness criteria for the 
second moments of solutions of equation (II. ID . 

The existence and uniqueness theorem for the stochastic differential delay 



equations have been established in [8|, [15|, |18| . Hence using the fundamental 
solution X(t) in the previous section, the solution x(t;<p) of (II. ip with the 
initial function (f> G BC((— oo, 0],R) is a 1-dimensional stochastic process 
given by Ito integral as follows: 

x(t;<f>) = x^{t) + / X(t - s)(o- + aix(s; 4>) 

Jo ,+co t>0, (3.1) 

+ a 2 I K{6)x{s - 9; <j>)d9JdW 81 

13 



where x^(t) is the solution of ( 12. ip defined by (12. 7p and W s is a 1-dimensional 
Wiener process. 

The first and second moments of x(t',(p) are very important for investi- 
gating the behavior of the solutions and are studied in this paper. Now we 
state definitions of the p th moment exponential stability and the p th moment 
boundedness. Here we denote by E the mathematical expectation. 

Definition 3.1. The solution of ( II. ip is said to be the first moment expo- 
nentially stable if there exist two positive constants 7 and R such that 

\E(x(t;(f>))\<R\\<P\\e'^, t > 0, 

for all cf) G BC{{— 00, 0], 1R). When p > 2, the solution of (II. ip is said to 
be the p th moment exponentially stable if there exist two positive constants 7 
and R such that 

E(\x{t-A)-E{x{t-4>))\ p ) <RH\\ p e-^, t>0, 

for all (f> <E BC((-oo,0),R). 

Definition 3.2. Forp > 2, the solution of ( II. ip is said to be the p th moment 
bounded if there exists a positive constant R = R(\\(fi\\ p ) such that 

E(\x(t;(f))-E(x(t;(f)))\ p ) < R, t > 0, 

for all cf) G BC{{— 00, 0], M). Otherwise, the p th moment is said to be un- 
bounded. 

We first investigate the exponential stability of the first moment. 

3.1. First moment stability 

From (13. ip . it is easy to have Ex(t; 0) = x<f,(t) from the Ito integral, and 
therefore Theorem 12.41 yields the following result. 

Theorem 3.3. Let «o be defined as in Theorem \2.3\ Then for any a > 
max{ao, — /i} there exist a constant K\ = Ki(a,fi) defined in (I2.17P such 
that 

\Ex{t;<l>)\<K 1 \\<l>\\e at , £>0. (3.2) 

Therefore ifao<0 the solution of (II. ip is first moment exponentially stable. 

Theorem 13.31 indicates that the stability condition of the first moment 
is the same as that of the unperturbed equation (12.11) . The stability is 
determined by coefficients a and b and is independent of the parameters 

<7i(i = 0,l,2). 

14 



3.2. Second moment boundedness 

Now we study the behavior of the second moment. Let x(t; <ft) be a 
solution of (II. ip . and define 



x{t\(t>) = x(t\<j))-Ex(t;<j)), M(t) = E(x*(t;<f>)) 



and 



N(t; s, 1) = E(x(t - s; (f))x(t - I; cf>)) (t, s, I > 0). 

Then M(t) = N(t; 0, 0) is the second moment of x(t;(p). Obviously, when 
t < 0, x(t; <p) = Exit; <p) = M{t) = 0, and when s > t or I > t, N(t; s, I) = 0. 
We introduce following notations: 



P(t) 



Q(t) 



F(t) 



(a + <7iEx(t] (fy + 02 K(6)Ex{t - 6; 

afM{t) + 2o- i( j 2 J K(s)N{t; s, 0)ds 



, t>0, 
t< 0, 



+ a 2 2 



Jo 



K(s)K(l)N(t;s,l)dsdl, £ > 0, 



, 0, 



t< 0, 



X 2 (t-s)P{s)ds(t>0). 



Applying Ito integral, a tedious calculation yields 

/•(t-s)A(t-Q 

N{t;s,l)= X(t-s-6)X{t-l-e){P{6) + Q(6))d8, (3.3) 

where (t — s) A (t — I) — min {t — s,t — I}. Therefore 

pt—S 

N(t; s, 0) = / X(t - 0)X(t -s-0) (P(0) + Q{6)) d6 
Jo 

and 



(3.4) 



M(t)= / x i (t-0)(p(^) + g(0))^. 



(3.5) 
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3.2.1. Additive noise 

When <j\ = a 2 = 0, we have only additive noise and the second moment 
becomes 

M(t) = o 2 f X 2 (s)ds. (3.6) 

Jo 

In this case, from Theorem 2.3, the sufficient conditions for the second mo- 
ment M(t) to be bounded or unbounded are given as follows. 

Theorem 3.4. Let a® be defined as in Theorem \2.3[ When 01 = 02 = 0, 
then 

1. if ao < 0, the second moment of (13. ip is bounded. Moreover, for any 
a G («o,0), there exists a constant C\ = C\(a) (as in Theorem 2.3) 
such that 

r 2 2 2at 

\M(t)-M 1 \< Ul °° e . , t>0, 

\2a\ 



where 



2„2 

0. 

|2a| ' 



Cfo, 



r+00 
Mi = lim M(t) = o 2 X 2 (s)ds < 

2. if a > 0, the second moment of (13. ip is unbounded. 

Proof. 1. If ao < 0, for any a G (ao, 0) we obtain 

T\/T(+\ s ~ 2 I /^ 2 2as 7 O i°o (1 „2at\ ^ W 7 !] 

M(t)<o C x e ds = ——(l-e ) < — — 
Jo \^ a \ \^ a \ 

from Theorem 12. 3[ and hence M(t) is bounded. Moreover, 

"+00 /•+£» /t2 J 2af 

-<2 2 / 2qs.„ W-'O 6 



|M(t)-Mi| 
and 



/+00 r+00 

X 2 (s)ds < C 2 o 2 I e 2as ds 



t ,2a| 



M x < C\ol f 
Jo 



e 2 ™ ds = S^> . 

2d 



2. If a > 0, from Theorem I2.3[ there exist a G (0, «o) an d a closed 
subset C/ C K + with m(U) = +00 such that 

|X(£)|>e at , Vie 17. 
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Thus from ()3.€5j) . 

lim M(t) >o% [ X 2 (s)ds >al I e ms ds > o%m(U) = +00, 

t ^+°° Ju Ju 

which implies 

lim M(t) = +00. 

t— >+oo 

Therefore, the second moment is unbounded. □ 

Remark 3.5. The critical case ao = is not discussed here and the stability 
issue remains open. 

3.2.2. General cases (o~i, a 2 are not all zeros) 

First, we note a very special situation that a, [i = 0,1,2) satisfy the 
following condition: 

H: do = 0, and there is a constant A such that h(X) = 
and a x + a 2 C(K)(X) = 0. 

In this situation, it is easy to verify that x(t) = e xt (t e M.) is a solution of 
( 11. ip with initial function </>(#) = e xe (9 < 0), and therefore the corresponding 
second moment M(t) = 0. This is a very rare situation to have a determin- 
istic solution of a stochastic delay differential equation, and is excluded in 
following discussions. 

The following result gives the sufficient conditions for the second moment 
of (13. ip to be unbounded when the trivial solution of (12.11) is unstable. 

Theorem 3.6. Let «o be defined as in Theorem \2.3\ If a^ > and the 
condition H is not satisfied, then the second moment of (13.11) is unbounded. 

Proof. We only need to show that there is a special solution x(t; <fi) such 
that the corresponding second moment is unbounded. First, we note 

Q(t) = £?((Ti5(t) + a 2 K(s)x(t - s)dsf > 0, 

Jo 

and therefore 

M(t) > F(t) = J X 2 (t - s)P(s)ds. 
Jo 
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Now, let A = a + ifi be a solution of h(X) = with < a < «o, then 
a^(t) = Re(e At ) is a solution of (J2~T]) with initial function (f)(9) = Re(e Ae ) (9 < 
0). Hence, for the solution x(t; (f>) of (II. ip with this particular initial function, 
we have 

P(t) = (Re[a + e xt (a 1 + a 2 C(K)(X))]) 2 

= («ro + e Qt Re[e^(cri + a 2 £(K)(A))]) 2 . 

Since the condition H is not satisfied, we have either <r Q ^ or o\ + 
o~ 2 C(K)(X) j^ 0. Thus, from a > 0, and following the proof of Theorem 
12. 3[ there are a subset U C M + with measure m(U) = +oo and £ > such 
that 

X 2 {t) > e si , P(t) >£, Vte U, 

where < a < oq. Thus, 



t— >oo 



lim / X 2 (t 

t^+oo J Q 



lim F(t) = lim / X\t - s)P(s)ds > em(U) = +oo, 



which implies that the second moment is unbounded. □ 

Remark 3.7. From the proof, for any A with Re(A) > such that h(X) = 0, 
if either <Jq ^ or o\ + o~iC,{FC){X) ^ 0, the second moment of the solution 
of (II. ip with initial function (f)(9) = Re(e ) (9 < 0) is unbounded. 

In the following discussions, we always assume a < 0. 

Now we study the second moment through the method of Laplace trans- 
form. First we note that both M(t) and N(t; s, I) have Laplace transforms, 
for detail proofs refer to Lemmas 13.91 and 13.101 below. 

The following theorem presents the characteristic function of (II. ip and 
establishes the boundedness criteria for the second moment of the solutions 

of dnp. 

Theorem 3.8. Let cto be defined as in Theorem \2.3\ and assume ao < 0. 
Define 

H(\) = A - (2a + of) - 2 (b + a t a 2 ) h(\) - a 2 2 f 2 (\), (3.7) 

where 

/■+oo 

A(A)= / K(s)g(X,s,0)ds, 



' oo r+oo \y m °) 



f 2 (X)= / / K(s)K(l)g(X,s,l)dsdl, 

Jo Jo 

and g(\,s,l) is defined as in (12.211) . Then 
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1. if all roots of the characteristic equation H(X) = have negative real 
parts, the second moment for any solution of (II. ip is bounded, and 
approaches a constant exponentially as t — )■ +00/ 

2. if the characteristic equation H(X) = has a root with the positive real 
part, and the condition H is not satisfied, the second moment of (13.11) 
is unbounded. 



From Theorem 13.81 H(X) is the characteristic function for the second 
moment boundedness of the stochastic delay differential equation (II. ip . We 
note that the characteristic function is independent of the coefficient o~q. But 
as we can see in the proof below, when the second moment is bounded, the 
limit lim M(t) depends on o~ Q . To prove Theorem 13. 8[ we first give some 

t— >oo 

lemmas. 

Lemma 3.9. For any a e (a ,0), there exist a positive constant K 2 = 
K2(a,4>) such that 



F(t) <K 2 (l-e 



2«t\ 



t > 0. 



(3.9) 



Proof. Since // > 0, «o < and (12.31) . from Theorem l3.3l for any a G («o, 0), 
there exists a positive constant K\ such that 



< 



< 



r+00 

/ K{6)Ex{s - 9- 
Jo 



10 
< K x 



K(6)Ex(s-6 

K{6)K 1 \\(j)\\e a{s - e) de 
K(6)d6 + 



+ 



< (l + ^i 



K(9)Ex{s - 9; 
K{6)\<f){s - 6)\d6 
K(6)d6 



(3.10) 
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Thus from Theorem 12.31 for any a G (a , 0), 

ft / r+oo \ 2 

^(i) < / C\e 2a(t - S) I a + cnExis- 0) + a 2 K{s - 0; <f))Ex{8; (fydO J ds 

< C^ 2 "* / e~ 2as (|a | + | < Ti|^i|H|e M + |«T 2 |(l + iir 1 ) 

< ^e^y (icTolH-Kl^l^llH- 1^1(1 + ^ 

= C^(|«T O | + |(7i|iiCi||0|| + |(T 2 |(l + iiCi 



2 

(is 



2 e~ 2as ds 



2 1 _ e 2"t 

|2a| 
= K 2 (l-e 2at ) } 

where 

^ 2 («,/i) = I^T (ko| + M#lM + [oral (1 + K x ) U\\f. 

The Lemma is proved. D 

A direct consequence of Lemma 13.91 is that F(t) has Laplace transform. 
In the following, we have similar estimation for M(t). 

Lemma 3.10. Let ao be defined as in Theorem \2.3\ and assume ao < 0, then 

M(t) < ir 2 e c " (l<Tl|+|CT2|2)4 , t > 0. (3.11) 

Proof. From (13.51) . we have 

M{t) = F(t) + I X 2 (t - s)Q(s)ds. (3.12) 

Jo 

To estimate the integral, we note that 

\N(t;s,l)\ = \E{S;{t-s)x{t-l))\<(E{x 2 {t-s)))^(E{x 2 {t-l)))^ 

< w-) + w-i) (313) 

by the Cauchy-Schwarz inequality. Therefore, we have 



t 

K(s)N(t',s,0)ds 

o 



< f K{s)\N{t;s,0)\ds 
Jo 

< -M(t) I K(s)ds + - J K(s)M(t - s)ds 

< -M(t) + - I K{s)M{t-s)ds (3.14) 
2 2 Jo 
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and 

-t rt 



K(s)K(l)N(t;s,l)dsdl 
Jo 

< f f K{s)K{l)\N{t;s,l)\dsdl 
Jo Jo 

< K{s)K{l)^ '- i '-dsdl 

Jo Jo 2 



2 

< 

~ 2 

t-t 



- I K(s)M(t - s)ds I K(l)dl + - I K(l)M(t - l)dl I K(s)ds 
2 Jo Jo 2 Jo J 

- I K(s)M(t - s)ds + - f K(l)M(t - l)dl 
2 Jo 2 Jo 

/ K{s)M{t - s)ds. (3.15) 

Jo 

It is easy to verify that M(t) is increasing on [0, +oo), and from f 12 . 2 1) . 

/ K(s)M(t - s)ds < M(t). (3.16) 

Jo 

Thus, from Lemma [3791 and (I3.12p -( 13~TT6]) , for any a G (a ,0), 

M(t) < K 2 + ( X 2 (t - s) (alM(s) + 2\a 1 a 2 \M{s) + (y 2 2 M{s)) ds 
Jo 

< K 2 + C\ (|(n I + \a 2 \f [ M{s)ds. 

Jo 

Finally, applying the Gronwall inequality, we obtain 

M(t) < K 2 e c "^ + ^ 2 \ 

and (13. lip is proved. □ 

Lemma 13.101 indicates that M(t) has Laplace transform. Furthermore, 
from (13. lip and (I3.13p . N(t; s, 1) (0 < s, I < t) also has Laplace transform. 

Lemma 3.11. Let Q(t) and M(t) defined as previous. Then 

C(Q)(X) = K 2 + 2a 1 a 2 f 1 (X) + alf 2 {\))C{M){\). (3.17) 
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Proof. First, from the expression of Q(t), we have for t > 0, 

C(Q)(X) = afC(M)(\) + 2a 1 a 2 e^ 1 K(s)N(t;s,0)dsdt 

Jo Jo 

r+oo rt rt 

+ °l I e~ Xt / K(s)K(l)N(t;s,l)dsdldt. (3.18) 
Jo Jo Jo 

A direct calculation yields 

+00 pt ft 

e~ xt / / K(s)K(l)N(t;s,l)dsdldt 
Jo Jo 

+00 r+oo ft 

I e- xt / K(s)K(l)N(t;s,l)dsdtdl 

+00 w r+00 

K(l) I K(s) / e- xt N(t;s,l)dtdsdl 
Jo Ji 

r + OO r + OO /"+0O 

+ / #(/) / K(s) / e' xt N(t;s,l)dtdsdl 

Jo Jl Js 

r+oo rl r+oo 

= / K(l) / K(s) / e- xt N(t;s,l)dtdsdl 
Jo Jo Jo 

r+oo r+oo r+oo 

+ / K(l) / K(s) / e- xt N(t;s,l)dtdsdl 
Jo Ji Jo 

r+00 r+00 

= / K(l) / K(s)C(N(t;sJ))dsdl, (3.19) 

Jo Jo 

and similarly 

rt r+00 

/ K(s)N(t; s, 0)rfsrft = / K(s)£(N(t; s, 0))ds. (3.20) 
Jo Jo 



+00 

e- X! 



'0 
Since 

r(t-s)A(t-l) 

N(t; s,l)= X(t-s- 6)X{t -1-6) (P(6) + Q{6)) d9, 

Jo 

we have 

C(N(t; s, I)) = C{X 8 Xi) (£(P) + C(Q)) . (3.21) 

We note 

C{M) = C{X 2 ){C{P) + C{Q)) (3.22) 
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by applying the Laplace transform to both sides of ( 13. 5p . Therefore, for any 
s, I e [0, t], (E2U) and (I3T23J) yield 

Wit *, 0) = ^T^pW = 9(\ s, l)C(M) 
and 



C(N(t; s, 0)) = -±*C(M) = g(\, s , Q)C(M). 



C(XX S 
C(X 2 
Thus, from (I3TT9J) and ( 13T20J) . we obtain 

/*+00 pt pt 

\ e- xt K(s)K(l)N(t;s,l)dsdldt = f 2 (X)C(M) (3.23) 

Jo Jo Jo 

and 

~oo pt 

e- xt K(s)N(t;s,0)dsdt = /i(A)£(M). (3.24) 

o Jo 

Finally, (l3TT7|) is concluded from (EH, (1X231) and (I533|) . D 

Now, we are ready to prove Theorem 13.81 
Proof of Theorem \3.8\ . From (13 . 1 7f) and ( 13.221) . we obtain 

£ < M > = c(x^-M + 2 LMX) + *lMV) C{n (3 ' 25) 

To obtain £(X 2 ) -1 , multiplying 2X(t) to both sides of ( 12. ip . we have 

!±!Lv± = 2aX\t) + 2bX(t) / if(s)X(£ - s)ds. (3.26) 

at Jo 

Taking the Laplace transform to both sides of ( 13.26P yields 

/•+oo 

-1 + XC(X 2 ) = 2aC(X 2 ) + 26 / K(s)C{XX s )ds, 

Jo 

which gives 

— l -^- = \-2a-2bf x {\). (3.27) 



C{X 
Now, from f!3.25|) and (13.271) we obtain 



£(M) = i^A) £(P) - (3 ' 28) 
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Let Y{t) = C- 1 (H- 1 (A)), then (153811 yields 

M(t) = Y(t) * P(t) = I Y(s)P(t - s)ds, (3.29) 

Jo 

where * denotes the convolution product. Now, the exponential bounds for 
M(t) can be obtained from f 1 3 . 2 9 j) . 
From Lemma [2.71 and note ao < 0, 

Jim |/ X (A)|= lim |/ 2 (A)| = 0. 

Re(A)— >-+oo Re(A)— >+oo 

Furthermore, H(X) is analytic when Re(A) > max(2ao,o)- Thus, there is a 
real number Bn such that all roots of H(X) satisfy Re (A) < (3 (refer to the 
discussion in [7|, Lemma 4.1 in Chapter 1]), where 

00 = sup{Re(A) : H(X) = 0, A G C}. 

Thus, for any (3 > (3 there exists a positive constant C 3 = C 3 (/3) such that 

\Y(t)\ <C^\ £>0. (3.30) 

Now, we are ready to prove the conclusions. 

1. First, from Theorem 13.31 and f 1 3 . 1 [) . there are two positive constants 
K 3 and K 4 such that for t > 0, 

(/•+oo \ 2 

o + aiEx(t; <p) + o 2 J K(s)Ex(t - s; <p)ds 1 

a + a 2 K{s)Ex(t-s;(f))ds\ + of (Ex(t; 0)) 2 

+ 2ai^x(t;0) (o-q + o- 2 / K(s)Ex(t - s;4>)ds 



o 



< (|<r | + |(T 2 |(l + lfi)|H|) ^H-cr^H^e 
+ 2|cT 1 |(|c7o|H-|cT 2 |(H- J ft: 1 )||0||) J ft: 1 ||0||e l 



where 



K 3 = (\<T Q \ + \(T2\0- + Ki 
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and 

K 4 = alKlUW 2 + 21^1^11011 (|or | + N (1 + K x ) 

We note that K 3 and K± are of order ||0|| 2 . 

If /3 < 0, for any f3 G (/3 , 0) there exists a constant C 3 as in (I3.30[) such 
that for t > 0, 



|M(t)| 



y(s)P(t - s)ds 



< [ C 3 e Ps (K 3 + K 4 e a{t - S) ) ds 
Jo 



C 3 K 3 f e Ps ds + C 3 K 4 f e^ s e a{t - s) di 
Jo Jo 

C 3 K 3 (l-e^) C 3 K^ l -e at ) 



a — (3 



< 



2C 3 K 3 2C 3 K, 

\P\ \<x-P\' 



Therefore, the second moment is bounded for any initial function G ((— oo, 0], 



Now, let 



M 00 =K [ 



, i Y(t)dt, 





then 



\M(t) - M 



t r+oo 

Y(s)P(t - s)ds - K 3 



Y(s)ds 



< 



rt r+oo 

/ Y(s) (P(t -s)- K 3 ) ds-K 3 \ Y(s)dt 
Jo Jt 

K A [ \Y{s)\e a(t ~ s) ds + K 3 [ 
Jo Jt 



\Y(t)\dt 



r+oo rt 

< K 3 C 3 e pt dt + C 3 K A e^ s e a{t ' s) ds 

Jt Jo 

< C 3 K 3 e^ + C 3 K 4 (e? t -e at ) 



m 



a — (3 



< CalS + T^rle*—"- 



(| \ a -fi\ 
Thus, there exists a positive constant C 4 = C 3 (j-jj + -, %r) such that 
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since max(a, (3) < 0, i.e., M(t) approaches to M ra exponentially as t — > +00. 
2. Assume /3 > 0. We only need to show that there is a special solution 
x(t; 4>) of (II .ip such that the corresponding second moment is unbounded. 
Similar to the proof of Theorem 13.61 let A = a + i/3 be a solution of h(X) = 
0, then x<f>(t) = Re(e At ) is a solution of ( 12. ip with initial function (f)(9) = 
Re(e Ae ) (6 < 0). Hence, for the solution x(t;<f)) of f 1 1.11) with this particular 
initial function, we have 

P(t) = (a + e a *He[e^(o- 1 + a 2 C{K){X))]) 2 . 

Since the condition H is not satisfied, we have either o~o 7^ or o\ + 
a 2 C(K)(X) 7^ 0. Thus, the function P(t) ^ 0, and hence the Laplacian 
£(P)(s) is nonzero. 
Since 

M[t) L \ H(s) ) 2 m T^] c _ iT H(s) 

with c > (3 . Similar to the proof of Theorem I2.3[ and note that C(P)(s) is 
analytic when Re(s) = c > 0, there is (3 G (0, f3 ) and a sequence {t k } with 
tfc — > +00 such that M(tfc) > e' 3 **, which implies that the second moment is 
unbounded. □ 

Remark 3.12. The critical case when /3q = is not considered here, and 
the issue of boundedness criteria remains open. 

4. Applications 

The functions /i(A) and /2(A) in H(X) depend not only on the coefficients 
of equation ( II. ip . but also on the Laplace transforms of X 2 (t), X s (t)Xi(t) and 
the delay kernel K. Though it is possible to calculate these two functions nu- 
merically according to Lemma |2?6| it is not trivial to obtain (3q = sup{Re(A) : 
H(X) = 0} for a given equation. Hence the boundedness criteria established 
in Theorem 13.81 are not practical in applications. In applications, one need 
to derive useful criteria according to the density kernel K and coefficients 
of the equation (II. ip . Here, we give some practical conditions, according to 
Theorem 13.81 for applications. 

First, in the case of discrete delay (K(s) = 5(s — 1)), we have 

£(XX 1 )(A) 
/l(A)= £(X 2 )(A) = ^ (A ' 1 '° ) 
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and 



m = %Wg = e -*. 



£(A' 2 )(A) 

Thus 

H(X) = \-(2a + a 2 ) - 2 {b + a 1 a 2 ) g{\, 1, 0) - erf e~\ 

which give the same characteristic function H(s) as in [13J, Theorem 3.6] 
(here, we have provided explicit expressions for the functions f(s) and g(s) 
in [13J by (12.241) ) . Therefore, sufficient conditions for the boundedness or 
unboundedness of the second moment can be referred to [13J . 

Next, if b = 0, the fundamental solution X(t) is known to us. Therefore, 
it is possible to obtain explicit sufficient conditions for the boundedness. Here 
we give a sufficient condition for the second moment to be bounded when 
b = and K(s) = re~ rs (j = 1 in the gamma distribution ( 12. 5p ). 

Theorem 4.1. Let 6 = and K(s) = re~ rs (r > 0). If a < and 

ai > 0, a 3 > 0, ai<2 2 — a 3 > (4.1) 



where 



a\ = 3(r — a) — <j\, 



a2 = 2r(r — a) — (2a + <7i)(3r — a) — 2ra 1 cr 2 , 
a 3 = -2ar(2(r - a) - a?) - 2r 2 (a 1 + a 2 ) 2 , 

t/ien t/ie second moment is bounded. 

Proof. If b = 0, the fundamental solution of (12. ip is given by 

e a \ t > 0, 



*<"-' 0, ,<0 

and ao = a. Hence the trivial solution of ( 12. ip is locally asymptotically stable 
if and only if a < 0. 

From the fundamental solution, we have for Re(A) > 2a, 

oo /"DO 



C(X 2 )(X)= e- xt X 2 (t)dt= e- {x - 2a)t dt 

Jo Jo 



A -2a' 



"oo /*oo — (A— a)s 



/oo ^oo 

e- xt X(t)X(t-s)dt = e -( x ~ a ^ s / e-^-^^^dt 



A - 2a ' 
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and 



/•oo poo 

£(X S X,)(A) = / e- xt X(t-s)X(t-i)dt = e~ ai - s+l n e^^di 

JO JsVl 

—{\—a)s-al 

e X-2a ■ ^'^°. 

-(A-a)Z -as 

A-2a ' °^ s</ ' 
where s V / = max{s, /}. Therefore 

£(X,X,)(A) J e -^- a >e~ a \ s > I > 0, 
^ ' *' j £(X 2 )(A) ~ { e-( x ~ a »e- as , 0<s<l 

Let K(s) = re~ rs (r > 0), then 

T 2?~ 
/l(A) = T~i ' /2(A) = TT— ., ,. 

A + r — a (A + r — a)(A + 2r) 

Thus from ( 13. 7ft . 

/ 9\ 2rcri(T2 2r 2 (T9 
fl-(A) = A - (2a + cr 2 ) - — - -|- -. 4.2 

v ; v u A + r -a (A + r-a)(A + 2r) v ; 

Hence H(X) = if and only if 

H(X) = A 3 + aiA 2 + a 2 X + a 3 = 0, (4.3) 

where 

a\ = 3(r — a) — a 2 , a2 = 2r(r — a) — (2a + cr 2 )(3r — a) — 2rcriO"2, 
a 3 = -2ar(2(r-a) -a 2 ) -2r 2 (ai + a- 2 ) 2 . 

From the Routh-Hurwitz criterion, all roots of H(X) = have negative real 
parts if and only if 

a,\ > 0, 03 > and a\a 2 — 03 > 0. 

Thus, the theorem is proved. □ 

The following theorem gives a sufficient condition for the unboundedness 
of the second moment for general situations. 
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Theorem 4.2. If either 

b + a 1 a 2 <0, of -2o x o 2 - a\ < 2(a + b) (4.4) 

or 

6 + 0i0 2 >O, o\ + 2a t a 2 - o\ < 2(a-b), (4.5) 

the second moment is unbounded. 

Proof. From (j2.22p . we have 

\g(0,s,l)\<l, 

and therefore 

/•+00 r+oo 

|A(0)| < / K( S )rf S < 1, |/ 2 (A)| < ( / K(s)ds) 2 < 1. 
Jo Jo 

Thus, we have 

H(0) = -{2a + a\) - 2(6 + «tkt 2 )/i(0) - a 2 2 / 2 (0) < 

when either f)4.4|) or (14.51) is satisfied. Furthermore, it is easy to have H(X) > 
when A G M is large enough. Thus the equation H(X) = (A G K) has 
at least one positive solution, which implies that /?o > 0, and the second 
moment is unbounded by Theorem 13.81 □ 

5. An example 

Here, we consider an example of following linear stochastic delay differ- 
ential equation 

dx(t) = -x(t)dt+ la 1 x(t) + a 2 K(s)x{t - s)ds) dW t , (5.1) 

where K(s) = re~ rs (r > 0). Fig. [1] shows regions in the (ai,o~ 2 ) plane to 
have bounded and unbounded second moments according to Theorem 14.11 
and Theorem I4.2[ respectively. Fig. [2] show sample solutions with (01,02) = 
(1, —2) (the star in Fig. [[]) and with (01,02) = (3, —0.5) (the circle in Fig. 
[Q, respectively. Simulations show that when (0-1,02) = (!> — 2), all sample 
solutions are bounded. But when (01,02) = (3,-0.5), the sample solutions 
have a positive probability to reach a large value. These numerical results 
show agreement with our theoretical analysis. 

Final Remark. All results in this paper are obtained under the ltd interpre- 
tation. Analogous results can be obtained for the Stratonovich interpretation. 
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Figure 1: The bounded and unbounded regions of the second moment obtained from 
Theorems 14.11 and 14.21 where r = 0.5. 





Figure 2: Numerical results of 1000 sample solutions of (|4.1|) . Parameters used are (a) 
(cr 1;C r 2 ) = (1,-2) (the star in Fig. [T]), and (b) (01,02) = (3,-0.5) (the circle in Fig. [T]). 
All initial functions are taken as x(t) =0.1 for t < 0. 
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Appendix A. Proofs of Lemmas 12.11 and 12.21 
Proof of Lemma l2J\ Since x<f,(t) satisfies (12.11) for t > 0, 

pt pt p+co 

x<j) (t) = 0(0) + a / x^(s)ds + b / / K(9)x^(s - 9)d9ds, £>0 
Jo Jo Jo 

and x<f,{t) = 4>{t) for t G (— oo, 0]. Therefore for t > 



M*)l < 


|0(O)| + |o| / \x^s)\ds + \b\ / / K(9)\<f>(s - 6)\dBds 

Jo Jo J s 




+ \b\ I f K{9)\x 4> {s - 9)\dBds 
Jo Jo 


< 


pt pt p-\-oo 

W + |o| / \x^s)\ds+\b\-\\<j)\\ / / AT(0)d0ds 

JO Jo Js 




pt pt-e 
+ \b\ j |x (0)| / K{v)dvd9. 
Jo Jo 


3n from (12. 


21) and (12.31). we have 



|^(*)l ^ 11011 + l a l / \x<f,(s)\ds 

Jo 

rt /»+oo /»£ 

+ |6|-||0|| / / K{9)d9ds + \b\ / |x (0)|d0 

JO Js JO 

pt pt p-\-QC 

< W + (H + |6|) / {x^lds + \b\ ■ \\(f)\\ / e^ s / e» e K{9)d9ds 

Jo Jo Js 

< IHI + (N + |6|) / Ms)|cfa + p|6|.|H| /e-^ds 

Jo Jo 

Using the Gronwall inequality, we obtain 

Mt)\< Il0||(l + *)e<l°l + l^ l *>0. 

Thus the inequality (EJ) is satisfied with A = ||0|| (l + Hf- ) and B = 

(\a\ + \b\). D 
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Proof of Lemma \2.2l Taking Laplace transform to both sides of ( 12. ip . we 
obtain 

r+oo j /j\ r+oo r+oo /-+oo 

/ e~ At j at = a / e~ xt x^(t)dt+b / e~ At / K(s)x 4> (t-s)dsdt, 
Jo dt J J Jo 

when £ > 0, i.e., 

f + OO /"+OO 

-0(0) + A£(x ) = a£(x ) + b / e~ At / K(s)<p(t - s)dsd£ 

Jo it 

-00 nt 



f+oo ft 

+b / e~ xt / K(s)x (j> (t - s)dsdt, (t > 0). 

Jo </o 



Since 

"+00 pt 



p+00 n f+00 f+00 

/ e~ xt / K(s)x <p (t - s)dsdt = / K(s) / e' xt x^(t - s)dtds 

Jo Jo Jo Js 



+00 /"+OO 

K(s)e~ As / e- xl x^{l)dlds 

("1 </o 



we have 



(A - a - &£(#)) £(&*) = 0(0) + 6 / e- A ' / ^(s)0(t - s)dsdt, 



which yields, 

^oo p+00 



Therefore, since >C(X) = /i _1 (A), we have 

/■< f+oo 

= X(t)<j>{0) + b X(t-s) K{6)(f){s - 6)d6ds, 

Jo Js 

and the Lemma is proved. □ 
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Appendix B. Proof of Lemma 12.71 

First, when Re(A) > max{2a , a, a + a }, since 

i r 1 



2ti J^oo h(ioj)h(\ — iu — a) 

1 /»oo 1 /*+oo 

W~ / TT^T / e-^^dtdu 

e -( A -°)' — / -^--dudt 
o 2tt ,/_ 00 &(«*;) 

OO -1 

e "^ x W* = S(A^0' (ai) 



then 



«*)<*) = ±/_ 



duj 



IX 



h(iui)(X — iu — a) 



J_ Z" 00 X f X 1 \ 

27r i /_ 00 /i(ia>) \/i(A — iu) X — iu — aJ 

1 +-LT . t£ W' A -'") *, 



where 



fo(A — a) 2tt j_ 00 h (iu) h(X — iu) (A — iu — a) 

= ma^) (1 + 9(a)) ' (R2) 

= MA_«) r WW-V. T A (B.3) 

is convergent for Re(A) > max{2a , a,a + a }. We have the following result 
for 0(A). 

Lemma B.l. Let g(X) be defined as in (IB. 31) . Then for any Re(A) > 
max{2ao, a,a + ao, —/•*}, 

Jim |<?(A)| = 0. 

|A|— »+oo 

Proof. First, when Re(A) > — fj,, 



\C(K)(X-iu) 



p + OO /"+OO 

/ e - {x - luj)t K(t)dt < / e- Re{x)t K(t)dt 
Jo Jo 

H-oo 

/ e^K(t)dt = p, (B.4) 



r- + 00 

< 



33 



and hence, 



\gW\ < 



\b\p r° \h(X-a)\ 

2 71 " 7-oo \h(iu)h(\ — ioo)(X — ioo — a) 



-doo. 



Given a positive constant ooq such that c^o > |A| + \a\ + |6| (A G C). Then for 

any \oo\ > cu , 

1 1 

< 



\h(X — iu)\ \ui\ — |A| — |o| — |6| 
Thus for any \u>\ > oo , 



h(ioo)h (A — iu) (A — ioo — a) 

Therefore when Re(A) > — [/,, 

\b\p 



< 



< 



1 



(\uj\ - \a\ - \b\) (\u\ - \X\ - \a\ - \b\) (\u\ - \X\ - \a\) 
1 



(\u\ - \X\ - \a\ - \b\) 



3' 



\9W\ < 



2n 
+ 

+ 



\h(X-a)\ 
\h(iu)h(X — iu)(X — iu — a)\ 



doo 



U)() 



\h(X-a)\ 



\b\p 
2tt 
\b\p 
2tt Jujq \h{iui)h{X — ioo)(X — ioo — a)\ 



■U!Q 

oc 



\h(iu)h(X — iu)(X — iu — a)\ 
\h(X-a)\ 



duo 



doo 



< ^x2 " X 

" 2tt 

+ 



\h(X-a)\ 



. ( w _| A |_| a |_| 6 |)s 

i% r ima -o)i 



doo 



2vr 



UlQ 



\h(iu)h(X — ioo)(X — ioo — a)\ 



doo 



b\p( \h{X-a)\ 



2vr V(w - |A|- \a\- \b\) 2 

\h(X-a)\ 



Now, since 



< lim 



+ 



\h(X-a)\ 



\h(iu)h(X — ioo)(X — ioo — a)\ 



-doo 



|A| +2|a| + \b\p 
a|->+oo (a; — |A| — |a| — |&|) 2 ~~ |a|+oo (oo — |A| — |o| — |6|) 



< lim 



0, 
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and when Re(A) > max{2a , a, — //}, 

r° \h(X-a)\ 

a|^+oo > /_ Wo |n,(zu;J/i(A — zu;j(A — zu; — a)| 

2 r° V \h{X-a)\ 

J |A|->+oo \h(iu)\h(X — iu)\\(X — iu — a)\ 



we have 



lim \g(X)\ = 0, Re(A) > max{2a , a, a + a , — //}. 

A|->+oo 



The lemma is proved. D 

Proof of Lemma \2.7\ Similar to (IB.lj) . we have, when s > I, 

„— As poo p iu)(s—l) p —(X—a) p —as 

-du 



27r J_ oa h(iu)(\ — iu — a) h(X — a) 

Thus, from (12.231) . when Re(A) > max{2ao,a}, we obtain 



—As ^oo iu(s-l) 



C(X 3 X t ) = — / — , -du 

2tc J_ 00 n{tu)(X — iu — a) 

e -Xs ,00 ^{s-l) / 1 1 \ 

2 71 " J-oo h(iu) \h(X — iu) X — iu — aJ 
e -(\-a)i e -as e -\ s ,00 be^—^ £(K) (A - iu) 



h(X — a) 2n J _ 00 h(iuj)h(X — iu) (A — iu — a) 

' (e-( x - a »e- as + e- Xs ~ gi (X,s,l)), (B.5) 



/i(A-a) 
where 

#iA,s,Z = — / — — — ; -du. (B.6) 

^ J-00 *i\iu)h\X — iu) [X — iu — a) 

Similarly, when < s < I, 



where 



~ ,x n h{X-a) f 00 be iu){l ~ s) C{K)(X - iu) , ,_ ^ 

g 2 (X, s, I) = -±- '- / ^ -^-du;. B.7 

2tt J-oo h{iu)h[X — iu) (A — iu — a) 
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From f lR6|) . ( TB~7j) and flR4|) . we obtain 

,~ /, ,m \h(X-a)\ f°° 161 p , /• -, ^ 

& A,a,0 < i-^- ^ / — ' ^ r^rdwO = 1,2 ■ 

27r > /_ 00 \h(ioj)h(\ — ioj) (A — iui)\ 

Thus similar to the proof of Lemma B.l, for Re(A) > max{2ao,a, — /x}, we 
have 

lim \gj(X, s,l)\ = (uniformly with respect to s and I, j = 1, 2). (B.8) 

|A|— >+oo 

From ( I2.2ip and (IB.2J) . we have for Re(A) > max{2a , a,a + a , — /i}, 
£(X S X Z )(A) 



g(X,s } l) 



(X*)(A) 

e -( A - a )'e- a8 + e- A8 ffi(A,g,Z) 
1 + P(A) 



> Z > 0), 



r( A -")'e-" + e-^ 2 (A, a ,0 ro < , < n (B ' 9) 



From Lemma B.l and (1B.8J) . when Re(A) > max{2ao, a,a + a , ~~ A*}, for any 



£ > 0, there exists a constant T = T (e), independent of s and / such that 
for |A| > T , 

\g{\)\<£, and \gj(X,s,l)\ < e (j = 1,2). 

Therefore for the above e and To, and |A| > To, from (IB.9J) . we have 

-(T -a)l -as FP ~T s 

< s <l, 




lim \g(X, s,l)\ = 0. 

A|^+oo 

Thus, ( I2.25P and ( I2.26P are satisfied and the Lemma is proved. D 
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